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The impact of the School Improvement Through 
Instructional Process (SITIP) program in Maryland schools was 
studied. The program encouraged application of research on planned 
change to implement one or more of four instructional models: Active 
Teaching, Mastery Learning; Student Team Learning, and Teaching 
Variables of **content** and '^time.** The study addressed four areas: 
impact, implementation, dissemination, and technical assistance. The 
extent of program impact was measured on educators and students 
through the use of questionnaires, interviews, observation, document 
analyses, and student assessment. The SITIP design was perceived as: 
(1) encouraging collaboration between the schools and the State 
Department of Education; (2) increasing communication using a common 
knowledge base about school and classroom effectiveness; and (3) 
helping local education agencies establish cross-hierarchical teams 
with the purpose of improving instruction. The models were perceived 
by local educators as having both subjective and objective value. 
Teachers* positive opinions had as much influence as standardized 
test data in determining program maintenance or expansion. Teachers* 
negative opinions or concerns had little influence in determining 
maintenance or expansion but did influence the relative impact of the 
project. Twelve tables are included. (JD) 
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Introduction 



Maryland's ScIh^oI 1 mprcn^emenL Through F ns t rue 1 1 ona 1 Process ("Sr'^ii') 
program t^ncourages application of researcli on planned change to implement ^^n*^ 
or more of four researched-hased instructional models. The Maryland State 
Department of Kducat ion (MSI)lO supports local implementation by providing, 
funds, training, and t^-^chnlcal assistance and by conducting evaluation vUh 
reports developed so that data-based decisions can be made.* The instruc- 
tional models used in STTTP are: Active Teaching, Mastery Learning, Student 
Team Learning, and Teaching Variables. All 24 local education agencies (LFAs) 
In the state voluntarily implemented one or more of the models. 

SITIP is a multi-year program consisting of interactive activities which 
are outlined below. 

1, Prep arati on (open systems planning): Identify needs and potential 
solutions. Draft a design. 

2. Initi al Commitment : Review plan with LEA superintendents. Ge*: 
commitment for local team attendance at awareness conferences. 

1. Awareness Conferences : Have each of the instructional improvement 
models presented by its developer at awareness conferences attended 
by LEA teams, MSDE staff, and interested others. Describe design and 
nature of (voluntary team) involvement. 

4. Local Proposals/Plans : Help cross-*hierarchical local teams draft 
proposals to implement one or more of the models. 

5. Implementation : Help LKAs implement selected models using their own 
strategies but involving representatives of aj.1 role groups. 

6. Dissemination : Encourage use of the models in many schools, and 
share information about successes between LEAs . 



* Three major evaluation reports will have been written by the time uirect 
involvement by MSDE comes to an end. The first focused on implementation 
for the period December 1980 to June 1982. See: Roberts, et al.. Instruc - 
tional improvement in Maryland: A study of research In practice , 1982. 
ERIC //: Full report. ED222486; executive summary, ED223553. The last, 
which will cover the 1983-84 school year, will focus on institutionaliza- 
tion. 
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T^M-hnLcaL Assist ance : Assign MSDF staff ("across d i s ions; tv asslsL 
Im.As In planning, implementati :>n , anil (Usseminat ion ; lo conduct: 
follow-ups; and to facilitate networking. Ruild (^apaciry; io not 
create dependency. 

' ^•^o^ ^<^w-up Training: ^:onduct an intensive three-day Irf^. inlng 
.session on each inodel for prospective irnpl entente rs C^eachers, 
school administrators, centra! office staff). Conduct annual or 
bi-annual follow-up training sessions (usli.g participatory planning) 
to maintain quality implementation. Assise LKAs (central offif:e 
staff) in planning/conducting turnkey training. 

^'K Asses smen t of Progress and Impact (cyclic): Have a "third parrv 
e valuator" collect and analyze data systematically and use (feed- 
back) information to make improvements and publicize succes.-^es . 

The act [v1 1 ies ■ outl ined above began in ]^^S0. All 24 ^.K^s were repre- 
sented at orientation conferences. Nineteen LKAs svibmitted proposals for 

implementation cl^rough June 1983. For the 1982-84 school years, five "new'* 
hKAs decided to participate. 



Tlie Instructional Models 
i:ach of the instructional models is described here. 

• Active Teaching (AT) is a system of direct instruction devel- 
oped by Thomas Good and Douglas Grouws at the University of 
Missouri. Originally designed for the teaching of mathe- 
matics, AT consists of the following components: 1) pre- 
lesson development — concepts and skills from the previous 
night *s homework are reviewed, homework is checked and 
collected, and students engage in mental exercises; 2) lesson 
development — prerequisite skills and concepts are briefly 
reviewed, new concepts are introduced via teacher explanation 
and demonstration, and student comprehension is assessed 
through controlled practice; 3) seatwork — uninterrupted, 
individual, successful practice is provided in order to 
increase proficiency in the skills and concepts taught; 4) 
homework — homework is assigned related to the concepts 
developed that day; and 5) review/maintenance — weekly and 
end-of"unit reviews help to maintain skills and concepts 
taught . 

• Mastery Learning (ML), developed by Benjamin Bloom and James 
Block, combines curriculum alignment and diagnostic/prescrip- 
tive instruction with a philosophy that all students can 
succeed. Essential components are: 1) developing a scope and 
sequence of oblectives, broken down into prerequisite and 
component skills: 2) providing appropriate instruction aligned 
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with tiin objectives to be mastered; 3) te^tin^; the st'uient's 
progress 1 ii mastering the objectives through the use oi a 
formative evaluation measure ("no fault" test); 4) provi.llnv^ 
students who have not achieved mastery with additional corre( - 
tive work in the deficient areas specified by the fo matlve 
tests, and providing students who have achieved mastery with 
enrichment activities to reinforce and supplement learning; ^' 
testltig final mastery of the objectives with a summative 
ovaluatioti measure; and 6) recording student progr-ess in tern:s 
of lu'dividual mastery of specific obiectives. "K-stery" is 
usual Lv defined as 80% of the students demonstrating success 
on at least 80% of the objectives in a given unit of 
inst ruct ion . 

• St udent Team L earning (STL) techniques use peer tutoring and 
team competition to facilitate student learning. Student 
ream-Achievement Divisions (STAD) and Teams-Games-Tournaments 
(TCT) were developed by Robert Slavin and staff at the Johns 
Hopkins University. Jigsaw was started at the University of 
California at Santa Cruz. The key factors of STL are peer 
interaction, cooperation, and competition. STAD is basically 
team learning; TGT is team learning plus competition by 
ability level; Jigsaw is team learning of specific elements of 
a program, with regrouping for peer teaching across elements. 

• Teaching Variables (TV) was developed by David Helms and staff 
at Researcti for Better Schools (RBS) . Two variables found to 
be stiongly related to effectiveness of instruction and stu- 
dent achievement were identified: "content" and "time." The 
"content" variable encompasses two factors: 1) assessment of 
prior lea.-ning, and 2) alignment of curriculum objectives and 
classroom Instruction to the testing instrument. The "time" 
var'able improvement cycle involves: I) measuring student en- 
gaged time (SET) via classroom observation, 2) comparing SET 
and opportunity for improvement, 3) reviewing and selecting 
research-based improvement strategies, 4) implementing 
strategies, and 5) using additional cla,isroom observations to 
evaluate the effectiveness of the strategies in improving SET . 

Evaluation Overvi ' ^ w 

The study addressed four areas: impact, implementation, dissemination, 
and technical assistance. 

While RBS had primary responsibility for the SITIP evaluation, the design 
called for LEA involvement. Guidelines were developed and MSDE staff reviewed 
them with LEA teams. Each LEA agreed to a coordinated evaluation effort with 
local staff responsible for collecting and summarizing data from students 



relating to attitudes and achievement. 



r;at. a were coilocted from MSI)F. stalT, and local rducators »"epreser C i np, t lie 
.!9 project, at /^'^ i.i;As, involving over 140 Rchools. Five general rnethods o\ 
(lava collectlcMi ^'o uk^oci: observatliMis , Interviews, ques t ionnai r '.^s , document, 
analyses, and measures oi student attitudes and achievement. DaLc' v;>m r- 
analvzed and reports were developed by staff of Research for Better Scliools. 
Kopc-'rt'-^ were made available to MSDE staff and LEA coordinators, and reviawr:d 
t.() derL-rmfne wha. t, if anv, improvements should be mac^e. 

S_t ate I nitiatives and Assistance 

S rn P was Initially designed by staff of two departmental units of MSOE, 
building on needs and successes of existing programs. Once approved the 
state superintendent, STTIP was reviewed by the Instructional Coordinat i p.g 
Council (i('(:) (tiio state superintendent, assistant deputy superintendent, and 
MSr»r' assi,stant superintendents each responsible for a particular division/ 
department). ICC members agreed that SITTP would become a jointly-sponsored 
program, coordinated by the assistant deputy superintendent CADS) , and 
supported by the person time of selected division staff with field responslbi- 
Mtitvs, These staff became the STTIP technical assistants (TAs) , e.ic.]\ 
"experteu" to spend abo\]t two days a month on the program. They continued 
theic u-ual taskr>, and, for STTIP, reported to the AOS.^ 
PI annlng 

Within MSDF three types of planning activities occurred: (1) resource 
allocation and policy making by the ICC, (2) program modification by MSnr 
divisions, and (3) program development and modification by the TA team. 



* The STTIP TA team was chaired by the ADS and included eight TAs (two per 
model) drawn from the Divisions of Instruction, Certif ic :tion and 
Accreditation, Instructional Television, Library Services, Compensatory, 
Urban and Supplementary Programs; and the Office of Project Basic. 
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® Reso urce a] locat ion: Continuation of TA support was '^i 
r. ~i~c he U"^ 8 2 - 8 3 ~y e"a r (at lOt 1 1 iTie for each TA") and for tl^e 
l98)-84 year (at 1 S% time for each Tk) . Local grants were 
appro\'ed, with from 33000 to $"^000 available fcr each LEA, 
but, for ^"^83-84, participating LEAs had to provide matching 
luiuK. Funding for 1 nstruct'ional Leadership (lonf c^rences , 
tolU>w-iip training, and evaluation wris also approved, with 
.iinounts for the 1 98 3-84 year cut by about 40% (reflecting 
overall budget cuts). 

• L^^og^^^\^ ''^ modi f i ^^at i on: MSDE division planning was independent 
and case-specific, involving modification of existing programs 
to incorporate cr .pts, strategies, or content of STTTP 
perceived as valuable and relevant to particular programs. 

For instance, the Division for Compensatory, Urban and Supple- 
mentary Programs used S iTlF-rel ated knowledge and processes 
for their annual state conference (attended by Chapter 1 
c(^ordinatt.rs and LEA assistant superintendents). The Division 
of Cert if lcc>t ion and Accreditation launched URATE (Utilizing 
Research to Affirm Teacher Education— URATE) , in which 
researchers (e.g., Berliner, Cohen, Hunter) addressed 
representatives of institutes of higher education. Also, the 
1982 Instructional Leadership Conferences (focusing on staf<" 
development) stimulated review of practices in several divi- 
sions, w^-th some modifications to increase impact. 

• P rogram development : TA neam planning related to all areas of 
the program, with most attention to training (Instructional 
Leadership Conferences, Follow-up, sessions and the 1983 
Summer Institute); the improvement of assistance to LEAs; and 
to evalua t ion . The more complex an area of activity, the 
earlier the planning began.* In general, an open systems 
planning approach was used: ohiectives and target audiences 
were specified; substance and process were developed together; 
material and political support were taken into account. 

Major outcomes of these planning activities Mother than the implementa- 
tion of the plans') included: (1) a general knowledge of SITTP by most MSDL 
staff, (2) sufficient conmiitment or interest by ser.ior and middle management 
to be willing to explore elements or knowledge bases of SITTP, and to continue 
(and expand) cooperative support: for technical assistance, (3) application of 



Complexity related to: extent of participant input in planning; process for 
approval and/or funding; number and variety of role groups involved as 
participants and/or presenters; number and variety of content aieas or 
models addressed. 



S 1 Tl P- . e t cd information, strategies, or processes in various iv<ist1np, 



prc^grans, and (^i) increased knowledge and skills In instructional impruvenent 
and plaiv.iori change hy member:^ of the TA teani ("which informally filtcrrd back 
into otl.^M- program areas) . 

l lannin,v> related to SITTP betveen MSDE and LEAs used several channels, 
involved various state and local groups, and related to: planning and pr^^iec: 
administration, implementation, evaluation, and training. 

• General SLTTP planning and project administration included a 
requirement by MSDE that each LEA complete a PEPPs (Promising 
Educational Program or Practices) form. These single-page 
forms addressed objectives, target audience, staff develop- 
ment, etc., and so served as summaries of local intentions. 
PEPPs were compiled and distributed to all LEAs, at the 
request of local superintendents, to facilitate local 
networking . 

• There were few implementation planning initiatives by MSDE, 
except with the five '*new" LEAs.* In general, the focus was 
on. maintaining communication (networking) so that good id'.vis 
could be shared across districts. Issues addressed were 
Influenced by findings reported in the evaluation of the first 
18 months of SITIP. 

• For the 1982-83 school year, LEAs were more involved in 
planning for evaluation . Of all areas, this one created some 
planning (and implementation) problems, partly because LEA 
evaluation plans had to be revised in 1982, and partly because 
"ownership" and understanding of the design and related tasks 
were not clear in some cases. 

• Planning for training took the greatest amount of time and 
effort of both MSDE and LEA staff. Statewide events included 
a three-day Summer Institute (July 1983) for 200 participants, 
a one-day Instructional Leadership Conference (May 1983) for 
500 participants (plus similar events for college faculty and 
MSDE staff), and four model-specific follow-up meetings.** In 



* Two LEAs chose Active Teaching, and each of the other models was -.elected 
by one LEA. The 19 other LEAs had been ia^^ol\^ed since 1981. 

* The Staff Development Branch of the Division of Ce. «^if ication and Accedita 
tion shared responsibility for the Instructional Leader hip Conferences. 
Two SITIP TAs were in that Branch, which facilitated coordiiia*:ion. 



.'uiclition, VAs ct^nc^ucted tralnln^^ .^.t tb^' request c\ sp-"^^' 1 ^' 1 c 
i.i'As. All .^f thesL' events required careful planning and so:;!t' 
l;ind .^1 fi^rin.i^ c^r informal needs ar.^^.es.sinent , eva 1 ua 1 1 oii , r^nti 
* ;> ' ! ow- n p , 

rd 1 n<i I i on arioiu\ t^vr^nt. s was facilitated by organ L/:ational st ^r.c^ t ' t s 

i 1 ud 1 Hi: rbc fact tbal tb.ore are onlv ?4 LKAs in 'he state"; , but was, 

neve r the 1 t\ss , .\ ch.alleTige that wa^-' ad (Pressed satisfactorily bv the ^A lean. 

There were trrree wavs in which Ll^A staff participated in stace- local ]Jlnnnin^ 

re'w'VfW, i nvo i \/emen t , and comrnitment : 

e Reviev; : MCDE shared preliminary ideas or di t docnmeni s with 
a particular group. Local input was invited and • M'ually 
given as suggestions for minor modifications. Sin. . S[TI. is 
voluntary, any LEA with strong negative reactions to tentative 
pldns had the option not to participate. 

• 1 nvol vemer t : MSDE invited local input during plaraing, some- 
times as an informal needs assessment, sometimes through a 
series of discussions with individuals or groups. Local 
influence on MSDE plc::nr. was strong, especially for traiiiing, 
"ometlmes, local involvf^ment was proactive (e.g., by the 
superintendents of the five "new" LEAs) . 

# Commitment : MSDE requested support through action fcllowing 
review and approval of plans. Usually the immediate action 
was local planning based on the state Initiative. 
Subsequently, implementation was expected. Commitment in the 
fo rrn of public support, acknowledgement, and recognition of 
STTIP successes was also encouraged during planning. Such 
commitment was given (e.g., all superintendents of "veteran" 
sites participated in team presentations at th^ Instructional 
Leadership Conference) and the general level of implementation 
of plans was very high. 

Sumnary. Planning was flexible, interactive, on-going, aad based on an 

open-systems approach. Existing organizational structures were used or new 

ones developed to facilitate communication and involve various interest group 

in MSDE-initiat . d plans. Within MSDE and between MSDE and the LEAs, efforts 

were made to coordinate activities and to strengthen or integrate existing 

programs witLi SITIP (or SITtP knowledge bases on instruction and planned 

change). Planning was timely, made good use of resources and available 



expt . ^'nvited local ;)c\rticlpat ion by role groups and 1^"^. such \snvs as 

tr. .•:'ilt in hi. 1 I'c^ir.ni Ltment to the program and real (not 1 ip-se rv i c e 
mi onuji.t at iiHi a almcst all sites. The combinacion of visible success- \nd 
vi^liu, 'v r- Lcipation also facilitated planning. One particularlv st-i^,-^.- 
influence iu plannirie, Wcu; the expertise and posit i of the ADS. As chrir c!" 
the rh.e Ar>'^1sr:u^t ^Vapcrliitendents ' Council, and the TA team, he r^ouK! 

tacililaLC Mif ornua C i cn^ exchange, and anticipate or design ways to link ^iT^? 
ami i> f: he r a c c i v i 1 1 e s . 
'h\n n injj* 

M5;nK- iv.)cM^sore(i training activit. related to SLTIP during the \^P^2-H^ 
vear included: (\^ an Assistant Superintendents' Retreat, (?.) an Instruc- 
tional headership Conference, and Follow up Workshops on esch model. 
Kach of those activities led to site-specific activities at some i.EAs. The 
thrcf* kinds of activities are described here, participant evaluations are 
presented, and follow-up activities are outlined. Attention focuse^- on 
training of local educators. 

Ass istant superinte nde nts' ret reat. MSDI^ sponsored a retreat for i KA 
and six MSDE Assistant Superintendents of Instruction in October, 1^82. The 
retreat focused on recent research on instruction and planned change. Presen- 
tations were made on school and classroom effectiveness (Jane Roberts, RBS) 
and on planned change (Susan Loucks, The NETWORK). During discussion 
sessions, participants considered how the information presented could he 
applied to the classroom, the school, and the LEA. Participants found the 
seminar useful and well-designed. Fifty-two percent of thera planned to share 

* Each event summarized here was described in detail in reports developed by 
RBS and submitted to MSDE soon after a given activity. Information was used 
by the TAs in planning subsequent events. 
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lu- iaforr.al-ion vith local educators In their school districts. Also, 
)hinned t.:, uso t.h- s^Mninar information to -Ian and implement change ^-trorts 
.'ithln their srliool .lisiricts in arcn- such 3s staff devc lopment , ciirri.uLuiv. 
iovclopn^-nr , and inst rir^t iona 1 Improvement. 

Three kinds of activities occurred as a result of the retroaM ^ or LTA--^, 
II. the st.ito love!, and amon^ TAs. Three LEAs invited the RBS speaker to 
repeat her workshop session ^or administrative and supervisory staff. At the 
state level, Chapt^-r T staff decided to focus on instructional improvement for 
tlielr annual conletence, and invited RRS staff to assist them. S^TIP TAs 
incorporated information and materials into thei. ovn follow-up training, and 
coordinatea SITIP activities with other local and state efforts to apply tl-.- 
shared knowledge base on instructional improvement. 

Instiactional leadership conference ( s) . A 1983 Conference was conducted 
with activities coordinated across MSDF divisions in order to meet various 
program interests. The objectives were: 

• to review resear h n the processes of planned and managed instrur- 
t iona 1 improvemen u 

• to learn the results from 19 Maryland local education agencies which 
have implemented planned change in SlTlP (School Improvement Through 
Instructional Process) for the last two years 

• to consider facilitating quality in teacher effectiveness. 

The first objective — planned change for instructional improvement 
was addressed by Karen Seashore Louis of the University of Massachusetts, Th.- 
second objective — SITIP implementation — was addressed by LEA teams, 
introduced by their respectiv.^ superintendents in a series of concurrent small 
group sessions each lasting A5 minutes. The third objective— teacher effec- 
tiveness — was addressed by Madeline Hunter of the University of California. 
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All local par 1 1 c iparit s received as advance reading materiri'^: "lustrii 

ticu^'il Improvement: A Svster.i-Wlde Appn/ach" (Roberts ^< Smith), and "^^'m- 
SclcMice of the Art of Teaching" ''Hunter'). Most LEAs provided sma 1 ^ i ■ 
parr I c i parU-s har.douts describing their SITTP activities. Son^' ;n r-.--" 
visual aids in their presentations. 

Hot]-! presenters conducted seminars for MSDK staff tho following-! 
Also, >iadeli[ie Ihinter conducted a one-and-a~ha 1 f day worksliop for over ^ -'i 
cf) ] 1 ep,e f acul ty . 

In general, the conference was successful, part icular y the pre^-'t'nt a t { ( 
bv LKAs and Hunter. While the content of Louis' presentation was valuable, 
participants reacted negatively to her delivery, which, in comparison to 
Hunter, was perceived as dry and academic. 

Follow -up STTIJ^ t raining . The SITIP design provides for follov-uo 
training each year for implementeis of each model. The purpor;es of su^:;. 
events arc,-: 

• to facilitate networking by bringing LEA teams together to exchaTi^'>,c- 
i nf ormat ion 

• to reinforce, clarify, or expand knowledge and skills needed to 
implement the model 

• to meet needs identified by local team members, including the n.n'i^- 
tenance of a support group and the continuing development of an 
up-to-date knowledge base. 

Follow-up events included: 

• Joint meeting: AT, STL, TV, September 16, 1^82 at MSDE 

• ML, September 28-29, 1982 at Harpers Ferry (near Frederick Count\0 

• STL, October 22, 1982 in Charles County 

• STL, March 24-25, 1983 in Worcester County 

• AT, May 17-18, 1983 in Kent County 
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Each of the Follow-up sessions led to further communica^ (^n between some 
I.F.Aft and the MSDE TAs . In several cases, especially for "new" cor.nties, FAs 
conducted site-specific workshops, sometimes assisting local coordinators, 
sometimes directlv conducting training. Also, since two TAs (for ML cv.id 
were in the MSDE Staff Development Branch, their knowledge of STTTP models 
influenced content of workshops and training institutes uhey conducted for 
principals and others not directly involved in SITIP. 

P^ach Follow-up session addressed the general purposes of such e^^ents and 
satisfactorily met participant needs. In all cases LEA progress reports were 
given, an outside consultant conducted at least one session, and both formal 
presentations and participatory activities were Included. This mix of 
activities appears to have been well-received, and participants particularly 
liked learning about others* activities — the more first-hand the better as is 
apparent from the STL site visits. If outside consultants were Involved, they 
were more successful if they attended to the guidelines negotiated with the 
TAs. 

Su.nniary . Training was designed for cross-hierarchical teams, was 
flirectly related to implementation of the SITIP models, included information 
and activities to reinforce content and process, took into account participant 
needs and interests, involved local teams as presenters, involved outside 
consultants as presenters (carefully coached by MSDE TAs), and was provided on 
the understanding that MSDE would provide assistance for LEAs wishing to 
follow through ideas with a larger number of local educators. The various 
kinds of training events reinforced each other, and MSDE also trieu lo 
establish a common knowledge base for all hierarchical levels. Communication 
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nmnng TAs and through the ICC facilitated coor^. .nation, and influenced 
training designs and content that reinforced application of research-based 
instructional improveinent and yet did not result in redundancy. 

Participant evaluation of events, the subsequent local requests ^or 
on-site presentations and assistance, and the scope and fidelity of ImpLeinen- 
tation, provide strong evidence of the value to participants of the S I i 1 i^- 
related training proviJed by MSDE. 

Technical Assistance 

Assistance to LEAs was provided by an eight-person technical assistance 
(TA) team under the leadership of the ADS. The team carried out planning and 
training activities and also worked in dyads to provide model-specific 
assistance to local imp lementers . 

Roles and responsibilities . While all TAs agreed that their responsibi- 
lity was to help local educators implement the models selected according to 
T.KA plans, each dyad defined that responsibility slightly differently. Here, 
roles, challenges, and tasks are discussed for the whole team with references 
to model dyads. 

TAs believed that the assistance role included: coordination of 
networking among LEAs using the same model; on-site visiting to acknowledge 
fidelity use; training and coaching; trouble-shooting; and information giving. 
They differentiated assistance to **veteran** LEAs (encouraging independence) 
and "new" LEAs (building trust, training). They understood their value as 
outsiders in crossing hierarchical boundaries within an LEA, and were some- 
times frustrated when their help was not sought. D-*fferences amonp ""As 
resulted in four different dominant role sets: AT — trainer/ coach ; ML — 
consultant/trainer; STL — observer/networker; TV — information linker/ 




trainer. These (inferences were Influenced by personal style and preferencr 
fe.g., ^T and ML^ , by the nature of a model, the relative availabilltv 
developers as trainers fe.g., STL), and by the number of "new" LEAs and ol 
"veteran" LEAs in which training was done to encourage expansion fe.p,., AT. 
TV) . 

Challenges related to conflicting demands, relationships, and reassign- 
ments. Conflicting demands ~ SITIP vs. regularly assigned responsibilii: lOs 
— required TAs to make choices. Most TAs looked fur ways to combine SITIP 
with their regular duties. For instance, the mathematics specialist inte- 
grated SITIP and regular tasks relating to his subject area and piggy-backed 
site visits with other field work. Attempts to balance (rather than inte- 
grate) roles were less successful, partly because the official allocatioi of 
10^ time to SITIP was insufficient, and sometimes because the "regular" role 
responsibilities we -e highly demanding or very different from TA responsibili- 
ties. The relationships challenge occurred when a TA sincerely wanted to 
provide assistance in a client-responsive manner, but the LEA suspected that 
all that MSDF staff wanted was to enforce implementation of their own ideas 
and programs. A second kind of challenge occurred when key local staff were 
reassigned: program activities faltered, and TAs needed to provide additional 
help in training, coordination, and communication. 

Ten task areas were addressed. During the twelve months ending June 
1983, the TAs spent 263 days on SITIP. Officially, each TA ^ould spend 10% of 
his or her time on SITIP. In practice, investments ranged from 2% (of the TA 
who handed over AT responsibilit es in December) to 35%, with one p-^ tner in 
each dyad investing 20% or more and the other partner investing 12% or less 
(of official workdays). Almost twice as much time was invested by TV TAs 
(47%) as by AT TAs (25%), with ML (32%) and STL (27%) between those two. 
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• Administration and budget (5%) consisted primarily of distri- 
buting and collecting forms from LEAs relating to funding and 
to local participation In STTIP training events. 

• Planning (10%) related primarily to training. 

• Knowledge building; consisted primarily of developing expertise 



In application of research on planned change and one or more 
STTIP models. Four TAs spent between 10% and 20% of their 
SHIP time (up to 8 days) on this, while the others speiit less 
than 5%. 

o M aterials development /identification work was greatest for TV 
training (15% of one TA's SITTP time, about 10 days) and 
minimal for other models. 

• T raining Included both conducting workshops in LEAs and at 
mode] follow-ups. Five TAs conducted training, with two of 
them spending about 25% of their SITIP time (12-24 days) on 
the activity, and the others spending less than four days. 

• General support Included over-the-phone assistance, networking 
sites with common needs or interests, and sharing information. 
Each '*lead" TA spent between 5% and 10% of SITIP time on this 
activity (between two and seven days). 

• Site visits were conducted by six TAs, each spending between 
two and eleven days (10% to 40% of their SITIP time). 
Specific purposes varied. 

• Evaluation was conducted by RBS , but TAs determined criteria 
for the design, informed LEAs of their responsibilities, 
clarified RBS' guidelines, helped LEAs develop evaluation 
plans, distributed and collected surveys and reports, and 
arranged for RBS' visits to pilot sites. Four TAs contributed 
to evaluation tasks, each investing between two and five days 
(5% to 10% of their SITIP time). 

• Dissemination took up to 15% of a TA's SITTP time (from one to 
14 days) and Included: assisting LEAs develop presentations 
for the Instructional Leadership Conference (May 4); referring 
to STTIP or making SITIP-related presentations to key interest 
groups; responding to requests for information from other 
states and from researchers in school Improvement and effec- 
tiveness; and making presentations at national meetings such 
as AERA. 

Accomplishments of the TA team included: providing leadership for a 
statewide school Improvement program while at the same time encouraging local 
ownership; maintaining communication within MSDE and among LEAs; developing 
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networks and teach ing/ learning opportunities for local teams t.) siar^^ 
successes and build expertise; developing expertise among themselves and 
applying it not only in STTIP but also in other areas; and incre -'ng 
awareness of eft'ective SITIP practices to researchers and educators ou^^^lde 
Maryland. The most apparent impact made by the team related to the statewide" 
rr'ainlng events. Ry involving others in planning, the team also made an 
ir.pact in that area. 

Impact relating specifically to assistance activities included: 
increased trust and openness In communication between T.EAs and MSDE; Increased 
efi'ort by some LEAs to carry out their plans; better linkage or a clearer 
common knowledge among hierarchical levels within LEas ; Increased Involvement 
by central office staff in some LEAs; changes In planning, decision-making, 
and/or communication (e.g., more Involvement of teachers) In some LEAs. 

Impact for each model included: 

• AT (trainer/coach) — better LEA/MSDE rapport, increased 
expertise and confidence of local educators, modifications 
made to plans to facilitate continued and willing participa- 
tion, application of strategies to facilitate expansion, and 
application of knowledge and strategies to facilitate imple- 
mentation in three *'new" LEAs. 

• >fT. (consultant /trainer) — better LEA/MSDE rapport, some 
increased expertise of local educators, application of know- 
ledge and strategies to facilitate Implementation in a **new'* 
LEA; and a negative impact in one LEA of confusion In cross- 
hierarchical communication and inadequate strategi^ing to 
overcome problems. 

• STL (observer/networker) — better LEA/MSDE rapport, applica- 
tion of knowledge and strategies tc facilitate implementation 
in a **new" LEA (including accessing the developer), to parti- 
cipate in networking* and facilitate expansion. 

• TV (information linker/trainer) — better MSDE/LEA rapport, 
application of knowledge and strategies to facilitate imple- 
mentation in a "new** LEA (including accessing the developer), 
to increase involvement of central office staff, to maintain 
or expand Implementation, and to decrease teacher resistance 
and facilitate continued participation. 
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The ah(^>e example.'- jf impact relate to TA actions. One other klml pI 
Impart — loral educators^ disappointment — related to TA Inaction. Specifi- 
cally* some \,VAs requested assistance, e.g., clarif icat-^ on of evaluation 
guidelines, and received only part of what they needed. In other insr.trM. o ;, 
I.F.As wished that TAs had been more proactive or capable in offering help. In 
general, what was done by TAs was helpful to LEAs, but in some cases more 
qualitv and quantity was needed. 
Summary and Conclusions 

MSDE initiated a statewide instructional improvement program that offered 
LKAs choices of exemplary models. The state department established an 
organization^^l structure across divisions, using existing expertise and 
mechanisms to provide coordinated support and to facilitate communication. 

Planning activities invited participation acr^ hierarchies and organi- 
'^lonal units at the state and local levels. On-going communication about 
STTTP interacted with related activities tn other pro?,ram areas so that the 

^age" was clear, consistent, and widespread. The "message** was the 
r<^«search-based knowledge on classroom and school effectiveness and planned 
change. 

Through various state-sponsored training activities, all members of the 
educational community in the state had the opportunity to learn about this 
knowledge base. LEA teams contributed to the training and learned from each 
other and from '^experts". Training activities were very well received and 
were followed-up by assistance from MSDE starf . 

SITIP TAs worked as a team to contributu to planning, design, ^raining, 
and provide on-site assistance related speciirically to the models. They also 
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monitored plans, administered grants to local prelects, and coorciinated 
(^valuation :''nd disc;eminat 1 cm activities so that data-based inprovenent ould 
he made and successes could be widely spread. 

The obvious impact of MSDE initiatives and provision of asslstanrc i ^ lu:- 
voluntary involvement of all 24 T.EAs , with all but one providing matching 
fundR for continuation in the 1983-8A school year. The appl :f.cat-ion of 
research on plannel change facilitated the process (e.g., helped build 
commitment, maintained energy levels). The use of research-based models built 
credibility, and the provision of choice allowed LEAs to maintain their sense 
of autonomy. Other areas of impact arising from MSDE initiatives related to 
communicat ion , coordination, widespread understanding of a common knowledge 
b^'ce, and a high sense of professional achievement on the part of those 
involved in SITIP. 

State initiatives in planning, training* and assistance are recognized by 
LEAs and also by such nationally-known researchers as Karen Louis who was 
impressed by such facts as the R&D knowledge base is clear; the role of 
technical assistants is research based; MSDE is providing quality information/ 
models with sound research bases; there is provision of training and funds for 
local implementation with relevant follow-up; LEAs have choices and are 
building their capacity; and there is attention to monitoring the implementa- 
tion of state-funded projects. Statements such as these, LEA reactions, and 
comparison to the literature on planned change and school effectiveness, 
indicate that Maryland's state initiatives and provision of technical assist- 
ance are exemplary. 
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I , o c al Implementation and Impact 
This section focuses on local implementation of the models: Active 
Teaching ^AT), Ma^^erv Learning (ML), Student Team Learning (STL^ , aid 
Teaching Variables (TV), examining the following areas: planning, scr .'kI 
intensity of implementation, time spent and responsibilities shared, impact, 
a.nd piirticipant concerns. 
PI a an i ng « 

Objectives addressed by LEAs can be divided into four categories: 
st\ident impact (objectives 1, 2, and 9); training (objectives 3 and A); 
teac'.er impact (objectives 5, 7, and 8); and curriculum alignment (objective 
h) , (See Table 1.) The level of achievement vari-^d across the four catego- 
ries, with the highest level in curriculum alignment followed by training, 
teacher impact, and student impact. These results are strongly influenced by 
the amount of time and effort that educators spent on the objectives. For 
instance, educators have been working on curriculum alignment for Project 
Uasic since 1979 and so have a sound foundation on which to build. Local 
achievement of training objectives war influenced by the fact that provision 
of information and training for SITIP began in 1980 and has been strongly 
reinforced by both MSDE and LEA activities since that time. Changes in 
teachers* behavior have arisen from that training, and achievement of objec- 
tives in this category was strongly influenced by the interactive support 
provided by LEA team members. The three objectives relating to improvement In 
students* achievement and attitudes can only be achieved after the other 
categories of objectives have been accomplished. These findings re' .force 
those of other school improvement studies which have found that major changes 
affecting students take from three to five years to bring about. 
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St.aiis 01 objectives: A] ' Models, ,luno \m 



Local Objectives 



1. Improve studont achievenitnt (basic skills). 

2. Improve student achievement (other subjects). ' 22 



3. Inform local educators about model. 
^. Train educators about model. 

5. Improve teachers' classroom competence. 

6. Ensure match of instruction, curriculum, 
and testsis), 

7. Help teachers become better organized. 

8. Improve time-on- task, 

9. Improve students' involvement in learning 
(motivation). 



Number of Projects 
^dressing Object ives 



Total 
N-29 



27 
26 
29 
18 

27 
25 
23 



AT 



ML 
J=7 



STL* 
N=8 



TV 
N=7 



Status** 



J of Proj ects 



^3 



43 



11 



13 



* Prince George's County did not submit data on status of objectives in June 1983. 
Status: 1 = Hoped for 

2 = Partly achieved 

3 = Achieved 



50 27 



A5 10 



33 56 



61 35 



59 38 



39 61 



66 30 



56 36 



48 39 
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Scope and Intensity of Imp] ementat Ion . 

Hurlng the 1^)82-8"^ schjo.l year, all 24 school districts were invc^lved in 
SiTIP, ?0 implementing a single model, three implementing two models, i\\u\ rue 
implementing three models. (See Table 2.) 

There were six AT projects , seven projects, nine STL proiects, r.ix T\ 
projects, and one combined AT-TV project for a total of 29 SITTP projects 
across the state. Over ^86 teachers and 3^,955 students in 139 elementary and 
secondary schools were involved in SITIP. Of the 139 schools involved, 65% 
were elementary, 3A% were secondary, and 1% were ''other** (i.e., K-12, 
vocational-technical). Fifty-two percent of the schools, 58% of the teachers, 
and 69% of the students in SITIP were using the AT model. More than 1 r< of 
Maryland's schools were involved in SITTP (AT — 6%, ML — 1%, STL — 3., , TV 
~ 1"/) . (See Table 3.) 

LEAs selected one of four implementation strategies : (l) district-wide, 
(?) pilot-district, (3) capacity building, and (4) lighthouse school. The 
lighthouse school strategy was the most popular (16 projects), followed by 
pilot district and capacity building each used for five projects, and 
district-wide used for three projects- 
There was a relationship among the implementation strategy used, the 
nature and extent of central office staff involvement, and the extent to which 
the model(s) used were perceived by central office staff to fit LEA priori-- 
ties. For instance, the district-wide strategy required central coordination 
and considerable central office staff involvement, and was used where the 
model fit closely with a local priority. The pilot-district strata. ^y was not 
quite as demanding and (with the exception of two LEAs) was used where the 
model fit local priorities.* The lighthouse school strategy, implemented as 



* In botn cases (of exception) the model as implemented did not support local 
priorities: expansion was curtailed and central office support wa*s low. 
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TL^Studont Tean Learning 
; Tl-.u- Var iaM es 



Stratepv: LS = L ight hou5;p sc>- ■. , 
PI)= Pilot district 
nW°D3 f;t ricr -\-idL- 
CB = Capac it V bu 11 cl ing 



Type : E= Elenen t a r v 

J/M«Junior high/middle 
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Table > 

.1 Int.Misi^v Sur^TT^ar-: All Models, hme 1^^S3 





P ro i e r t 


School s*^ 


Teachers 


Stiidc^r 


Its 


Models 


n 






<;/ 













Act ive Teaching, 


1 







7 ? 

L ^? 
S 20 




3 7 2 


38 


2A , 037 


o ? 


Masterv Learning 


1 




n 

E A 
S 8 
0 1 


9 


203 


21 


A ,603 


1 3 


Student Team 


8 


28 


A2 


30 


113 


11 


3,732 


1 1 


Learning 






E 28 
S lA 












Teaching Variables 


7 


2A 


1 ? 

E 6 

s s 

0 1 


9 


98 


10 


2,58-^ 


7 


Total 


29 


100 


130 

E 90 
S A 7 
0 ?. 


1 00 


986 

1 


100 


34,955 

1 


100 



* Although Prince George's County implemented STL in about 10 schools, no 
"hard" data were available at the end of the school year Therefore, 
this LEA is not included in these results. 

** One school is implementing two projects - AT and TV. It is counted once 
under TV. 

Schools : E = Elementary 
S = Secondary 
n = Other 
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dt'signed at all sites, rpqii w-ed a lit between the model and the ^rlv^ol's 
pr ; v.r i ^ 1 t«e. (not necessarily the district's priorities), and central offiro 
adiiUiilstrat i vo supporr, F.xpanslon occurred beyond the lighthous^e site onlv 
v/ric-n: (1 tluM-o was impact on student achieverrent (objective value); ^ ■'^'> 
teachers liked the model Tsubjective value") ; and (3) central office staff 
provided additional suppr^rt (usually to make the necessary arrangemer.t s For 
Stat f in otlti^r schools to attend training). The capacity building strategy 
Wcis centrally coordinated in two LEAs and school-based at three sites, with a 
fit between the model and LEA priorities at only one of the latter. The 
greatest weakness of this strategy was that once teachers were trained, in 
most cases they had high autonomy and low interactive support (reflecting low 
involvement of central office staff), and the fidelity and frequency of 
implementation was not as graat as for other strategies, 

Tliese findings suggest that the closer a model was to existing LEA 
priorities the more likely it was to draw central office involvement, and sub- 
sequently lead to strong and widespread classroom use. Converselv, when the 
model did not f it a district priority, it could be well implemented in a 
school where it fit that school's priorities but was not likely to be widely 
used, and its survival depended more on the individual teachers involved. 
Implementation strategies initially selected by LEAs reflected the amount of 
energy and commitment of local educators which was based on the fit — as they 
perceived it — between the model and their priorities. If, subsequently, ic 
became apparent that the fit was greater or smaller than at first perceived, 
the strategy was changed. 

Fidelity relates to the extent to which teachers implemented the models 
as designed. AT had the greatest fidelity, with 72"' of the teachers 
implementing all six components, as compared to ML where 23% of the teachers 



rnrried out all ten components, and STT. where 33" oi > teaclit-' s rarrie-/: -\:{ 
the five required components. For AT, no single comp ' it was addres-'c-;! ^^v 
less tlian 88% ot the teachers, as compared to ML (^.^'O arid STL ( Z^.' ") . F m ' . 
the ma;orltv of the educators (6?.^/.) implemented the time vari<il. le. Most 
the teacfiers (727.) had been observed by principals and vice-principals, an.j 
uyA reported strateglzing during staff meetings. 
Time jj^^t and Respon s ibilities Shared . 

Til is section summarizes the amount of time spent on SITIP activities for 
all four models by each role group during the 1982-83 school year. 

The average number of months* involvement by t eachers for three models 
(AT, ML, TV") was eight months, with no one involved for less than five months. 
AT Implementation was continuous for the specified number of months. With thr 
exception of some sites, teachers did not use Ml and STL continuously 
during those months. TV teachers were usually observed at tht. beginning and 
end of the time, applying im.provement strategies in the interim, if appro- 
priate. During the period that teachers were directly involved, the average 
time spent during a given week ranged from 21% (STL) to 397. (AT) ^ For thret^ 
models (AT, ML, STL) elementary teachers spent less time (15% to 23%) than did 
secondary teachers (23% to 51"). This reflected the fact that elementary 
teachers used a model for only one or two curricular subjects, while any 
secondary teachers involved used the model for his/her subject area specialtv 
with a relatively large number of classes. For TV, secondary teachers spent 
19% of their time and elementary teachers spent 33% of their time teaching 
subjects for which **time** observations were conducted o the **conteno ' 
variable addressed. This reflected the higher credibility which the TV data 
base had among elementary teachers. 
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In order of Investment of classroom time, models were: AT, ML, TV, STL, 
Investment varied from one site to another, Influenced strongly by administra- 
tive decisions and the amount of davelopraent work completed In the flfRt year, 
^'actors working against high Investment of classroom time Included: (I) need 
for materials (STL, ML); (2) need for preparation time (ML, STL); (3) pressure 
to cover the curriculum In a given amount of time (ML, STL); (A) relative 
suitability of a model to the curriculum (STL); (5) relative suitability of a 
model to a grade level (TV, secondary); and (6) negative experiences In early 
implementation which were not totally resolved by local administrators (some 
sites for AT and MT. , perceived most strongly for TV), Factors facilitating 
high investment Included: (1) availability of materials (ML, STL); (2) low 
complexity of the model (AT); (3) suitability of the model to a curriculum and 
grade (AT); (4) successful application experienced by teachers early in the 
project (AT, STL); and (5) successful application facilitated by local 
administrative support (all models in some slte.^, but perceived most strongly 
for STL), 

The average amount of time Invested by central office staff and school - 
based administrators ranged from nine or ten days for AT and STL, to 23 days 
for ML. Individual administrators spent as few as two days on SITIP to an 
almost full-time commitment. With the exception of TV, central office staff 
spent almost twice as much time as school-based administrators. In all cases, 
combined time of administrators was Invested least in materials identification 
and/or development. For thr^e models (AT, * STL) most combined time was 
spent on supporting school implementation and 3tratlon. The f A\er three 

areas of activity — inservice, dissemination, evaluation — took relatively 
little time. Since appropriate materifl1« were essential for ML and STL, and 
since administrators Invested so little in this activity, classrootii use was 




reduced unless teachers already had materials or were given release time (or 
development. Given teache*:s^ concerns and needs relating to TV, greater 
Investment In suppc^rt (rather than administration) was desirable at some 
si tcs . 

Interactive support included both logistical and affective support: 
Information exchange; training (both traditional inservice and one-on-one 
coaching); provision of materials and other resources; arrangements for 
teacher release time; assistance in development of quality materials, tests, 
record-keeping systems, etc.; acknowledgement and publication of success; and 
supportive use of feedback to encourage improvement. Support was rated for 
all role groups by the three local role groups (on a five point scale, l=very 
poor, 5=excel lent) , and results are presented for all four models in Table 4. 
While ratings of developers' support are relatively unimportant at this stage 
of Implementation, the somewhat low ratings for central office support (below 
average — 2,98 — for TV, to 3,82 for STL) are of concern where projects are 
not school-based, and where the LEA expects SITTP Implementation beyond a 
single school , 
Impact , 

This section discusses Impact for all models on school systems, central 
office staff, schools, school administrators, teachers, and students. 

As can be seen in Table 5, the most common Impact at the district level 
was the commitment and sharing among educators (reported for AT and ML) which 
was encouraged by the SITIP design. Also, for two models, policies were put 
into practice to facilitate implementation and encourage institutioaalization. 

Knowledge of a new teaching or observation strategy was noted by central 
office staff for all models, plus acknowledgement of AT's influence on 
improving organization for instruction. The strongest area of impact at the 
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Table ^ 

Perceptions of Support Received: All Hodels, 1982-83 



i^upport Groups 
Hodels/Respondents\. 


N 


Teachers 


School 
Administrators 


Central 
Office Staff 


HSDE 


Developers 


Arflvp Tp^ri ifio 


1 1 n 

112 


3J9 


3.83 


3.79 


3.61 


3.2« 


lidMtliy Lcdrnillg 




^.11 


3.95 


3.81 


3.6^ 


3.21 


Student Team Le.uning 


86 


^.12 


^.12 


3.82 


3.9^ 


3.12 


Teaching Variables 


61 


3.M 


]M 


2.98 


3.29 


2.90 


Totals 


33^ 


3.9^ 


3.90 


3.65 


3.90 


3.29 



ratings range from a low of 1.00 (very poor) to a high of 5.00 (excellent). 
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or grades 



,\1 



i.ci'ir.il fitfiiT :;t;ifj 



M^Diijis ard ^ndel'i 



ERIC 



* Reported in number ot lEAs: 

'\ctlvc Tnchlns Histery le.irr,in|! Student Tm |,,rninf Teaching "arlablos 

lm(.<^.-t amis rpportpj only vtiriii stateri M- two or oiore ir,\. for a piv,,, norfe!, 



School /\(i[iiinis_t_rators 



sen, 'ol level was sharing among educators, with continuity and cotis i sLency 
across classes. Interest, appreciation, and support were valued, as v^as 
closer monitoring and better organization for instruction. Principalis and 
other school~bas«"d administrators for all models valncH new t:» aching or 
observation strategies, gained an appreciation for teachers* capability (AT, 
Ml), and strengthened their belief in traditional teaching (AT), The Impact 
of involvement in SITIP, in terms of t eachers * understanding^ the models and 
improving their teaching ability, is summarized in Table 6, with the percent 
of teachers noted for each area of impact for each model. The relatively low 
perceived impact of TV may have been influenced by the amount of training, by 
the number of teachers who were found to have satisfactory engagement rater; 
(time-on-task) and therefore saw no need to change, and/or by the interactions 
between observers and teachers. 



Table 6 

Percent of Teachers Impacted by Involvement: All Models, 1982-83 



Impact 


----.^...^^Models 


AT 


ML 


STL 


TV 


teachers 


understaviding model 


72 


73 


80 


64 


teachers 
ability 


improving teaching 


66 


64 


50 


28 


teachers 
teaching 


seeing no change in 
ability 


13 


16 


27 


36 



Each of the three local role groups rated Impact on teachers in terms of 
enjoyment, increased knowledge, and Increased skills (on a five pol scale 
where 5,00 « strongly agree). Responses are summarized in Table 7. Mean 
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Instructional lmpa:t as Perceived by 
Survev Re.spondLMts: k\ \ Mculels 198?-8' 



I tnn ,1 r t" nn T n c r rn r ^ 1 nn M — 

- ■- ^ 


Models 


AT 
122 


ML 


STL 


TV 

D J 


Total 

J jU 


Ins^tuictional Value 










1 — 


Works in classroom. 




4.35 


4.42 


4.00 


4,35 


wtjrth the work it takt ^ 


4.29 


'j 85 


4 18 






Is a VOrftluhflo tPrT rhino nnnr,'\opU 


4.38 


A. 2?, 


4.43 


3.79 


4.26 


Impact on Te.f.hers 












Teachers enjoy it. 


4.02 


3.77 


4.17 


3.56 


3.92 


Tcachors }i;^vp inrrpa«;pr1 l'nf"iuloano 


4.08 


4.08 


4.14 


3.60 


4.01 




4.05 


4.08 


4.06 


3.51 


3.96 














Students: enjoy it. 


3.88 


4.09 


4.^7 


3.52 


3.99 


Students are less disruptive. 


3.88 


3.16 


3.65 


3.11 


3.62 


Students' achievement has increased. 


3.59 


3.76 


3.76 


3.08 


3.58 


uuuuciito die LCainiLl^ lUULCt 


3.61 


3.67 


3.60 


2.81 


3.48 


Students' general behavior is better. 


3.73 


3.09 


3.57 


3.08 


3.43 


Time 












Teachers spend more time preparing students. 


3.09 


4.01 


3.93 


2.69 


3.43 


Teachers cover curriculum in less tirie. 


3.13 


2.51 


2.56 


2.79 


2.79 



Mean ratings range from 1.00 {sf-ongly disagree) to 5.00 (strongly agree). 
AT=Active Teaching, ML=Mastery Learning; STL^Student Team Learning; TV=Teaching Variables 

0 '1 



ERIC 



ratings in all cases indicated that impact on teachers in all areas did occur 
to some extent, with greatest certainty among local educators for STl and 
least f or TV, 

More specific kinds of impact on teachers, in terms of Increasec^ kiu v - 
ledge and skills and strengthened attitudes, are summarized in Table 8. For 
each kind of impact for each model, the number of LEAs where that impact was 
found is presented Since most LEAs hoped that teachers would improve skills 
relating to instruction, impact in that category is particularly important. 
Since each model emphasizes particular activities, comparisons are not always 
relevant. However, the first three skill areas listed are addressed by all 
four models, and results indicate that a large number of LEAs found that 
teachers made iir ^-rovements in teaching/observing, classroom management, and 
assessing and addressing student needs. For three models (AT, MT., STL), these 
results indicate that in 50% or more of the LEAs, impact on teachers reflected 
the objectives or claims of the mo^-wi(s) ii. ilemented. For TV, appropriate 
impact was weaker (e.g., kn*" ;iedge of time-"i-task in 33% of LEAs, skill in 
effective use of time ■* . 33% of LEAs), which may be related to the fact that 

of teachers -d not need to make changes to improve time-on-task, or may 
have heen influ :^ced by the strategizing for improvement (only A4.7% ot 
teachers we" e involved in team strategizing). In general, impact on teachers 
\jaf posifj-ve and clearly related to the model(s) implemented. 

I*apact on students as perceived by local educators is presented in Tables 
7 ard 9. For each kind of impact for each model, the number af LEAs where 
t^ at impact was found is presented. Across all models, the stronger, areas of 
impact perceived by local educators were: improved student attitudes toward 
learning and school and about their ability to learn; increased student 
achievement as indicated by test scores, and mastery and retention of facts 



Table 8 



mpact ot Implementation on Teachers: All Models, 1982-83 



Impact : teachers have. . . 



Increased kn owj^edee 

-of components or procedures of effective teachinp 
-of tirae-on-task ' 
-of curriculum alignment and program 
-of research and learning theory 
-about teaching and learning through staff 
development /observation 

im proved skills 

-in a new teaching/observation technique 

-in classroom management/organization/planning 

-in assessing and addressing student needs 

-in specific components of effective teaching 

-in effective use of time 

-in use of peer tutoring 

-in working with students (e.g., motivation) 

-in curriculum development 

-in instruction 

Strengthened attitudes/perceptions 
-about teaching 

-of teachers' confidence or self-image 
-of the value of traditional teaching 
-of the value of specific components of effective 
teaching 

-that the larger group must be emphasized 

-of what students can accomplish 

-of how well students can work together 

-of the importance oi keeping students on task 

-that teachers must teach everv day 



N is the nurnbor of LFAs implementing a given model. 
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AT 
7 



5 
6 
6 

3 
7 



3 
3 
2 
I 



Modeb 



ML 
7 



4 
3 



7 

7 
3 



6 
2 



STL 
8 



6 



TV 
6 



2 
2 
1 

9 



5 

J 
3 



ERIC " '^''^ Ml-Masterv Learning; STL=Student Team Learning; TV=Teachinp, Variables 



Table 



l!np<ict of Implementation on Students: All Models, 19h;-83 









Mode 1 s 





Impact on Students 




A T 


MI, 


STL 






\^ if- — 


7 


7 


Q 


b 

J- 


Imp reeved attitudes or awareness 








— 


-about their learning ability 




3 


5 


3 




-about their learning responsibilities 






o 






-about . earning/ school 




1 


4 


8 


'7 


-of their strengths and weaknesses 






J 






— anouL Ler>Lb 






2 






-about classroom behav lor/ time-on- task 










A 


-nt teacher interest 










1 


— ot value of being organized 










1 
I 


Increased achievement 












-in test' scores 




5 


5 


A 


3 


-in grades 




i 


1 


A 




-in p,onerai 






1 






-in mas tery/ re tent ion of facts and skills 




/. 




3 




-in problem solving and conceptual understanding 






1 






-especially for lower achievers 






1 


2 




I^enefitted from better instruction which provides 












-a structured, consistent format 






5 






-a clear understanding of teacher expectations 




k 


2 




1 


-a greater variety of activities 








3 


1 


-effective learning activities 




3 








-a nore complete instructional program 








1 


I 


-better use or time/more materials covered 












-opportunity for independent work 




1 








-opportunity to relearn (after no fault test) 






3 






-opportunity to advance 








1 




-special benefits for slower students 




1 








-more individualized instruction 




I 








-peer tutoring/working in groups 








3 




-large group instruction 




1 








-more organization 












-more attention to academic content 










I j 


-fewer gaps in skill development 






I 






-compe t i t ion 








1 




-less pressure 






I 






-recognition of success 








1 


1 



* N is the number of TEAs implementing a given model. 



AT=Active Teaching; ML^Mastery Learning; STL=Student Team Learning; TV«Teachin^ 
Variables. 
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and skills; and benefits derived from instruction in a structured, consistent 
format with a clear understanding of teacher expectations. In general, 
educators offered statements indicating that ML, AT, and STL had somewhat more 
impact on students than TV. 

Student attitude data were summarized projects using either a brief 
questionnaire or a longer inventory (Learning Environment Inventory for grades 
5-12, My Class Inventory for younger students).* The questionnaire was used 
for three models by seven LEAs (Allegany, Baltimore County, Carroll, Cecil, 
Dorchester, St. Mary's, Worcester). Results were positive for all items at 
all sites. Students knew the difference between SITIP and regular instruc- 
tion. They found the lessons relatively easy, enjoyed and understood them, 
considered that in comparison to regular lessons they were better, and 
students learned more and got better grades. Overall, this last criterion 
t'hetter grades) and the first (ease of lessons) drew the least certain 
responses from students, with the total mean on those items pulled down by 
responses from older students (grades 4-12) — possibly because they are more 
discriminating than younger students. In general, mean scores for STL were 
higher than for the other two models. 

Results of the inventories (Anne Arundel, Baltimore City, Caroline, 
Charles, Worcester) indicate that the means for each project and across the 
three projects were better than national norms for secondary students on four 

* The Learning Environment Inventory (LEI) measures 15 dimensions, eight of 
which were relevant for assessing impact on student attitudes. Four dimen- 
sions are included in the My Class Inventory (MCI). Each is defined: 
Competitivenes_8— "Students compete to see who can do the best work; Satisfac- 
tion — Students enjoy their class work; Difficulty — The work of the class is 
difficult; Friction — There are tensions among certain groups of students 
that tend to interfere with class activities; Disorganization — The class is 
disrreanized; Apathy — Failure of the class would mean little to individual 
membt 3; Favoritism — Certain students are favored more than the rest; 
nvir ament — The books and equipment students need or want are easily 
available to them in the classroom* 
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dimensions: satisfaction, difficulty, apathy, and environment. There war> 
room for improvement in relation to friction for all sites, for favoritism at 
all secondary sites, and disorganization at two secondary sites. There were 
no significant differences between models, regardles- of the fact ch^t Sfl, fs 
designed to reduce friction and avoid favoritism. 

Cognitive achievement data from standardized mathematics tests were 
reported by four projects — one in AT and th;ee in MI.. In all cases, gains 
were greater than normally expected, with most significant improvement found 
for low or middle a sieving students. Eight projects reported data based on 
teacher-made criterion-referenced tests (AT=«2, MT.=A , S'rL=2) . Tn most cases, 
STTTP students did better than students in "regular*' classes, with gains made 
most consistently by below average students. Data supported claims for ML 
that at least 80% of the students achieved mastery (established at 80% or more 
of the course objectives mastered). 

These results support developers' claims for AT, ML, and STL. However, 
direct cause-and-ef f ect conclusions should be made with caution, attending to 
the nature and extent of implementation relating to a given set of results. 
Participant Concerns and Recommendations^ . * « 

Concerns were reported by participants of all projects, and were 
categorized as being related to the model(s) or to the general process of 
implementation. (See Table 10.) Most model-specific concerns related to 
management — the need for time and materials for effective implementation. 

* In the 1982 report, concerns were analyzed using the Stages of Concern (SoC, 
developed by the Center for Teacher Effectiveness at the Universe' i-y of 
Texas). In general terms, that same framework Is used here. Stages are 
roughly developmental (Awareness^ Informationf Personal, Management, 
Consequences, Collaboration, Refocusing) as an individual or group learns 
about an innovation, uses it, and fits it into existing activities. 
Concerns in earlier stages need to be satisfactorily addressed before 
participants can be expected to move to another phase of activity. 
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p.i po rvn rk 

- - r n:; li i ri- s : > mich s t ud .:n t t e s 1 1 i^ft 

lu.juirt's too mvicli In r.oneral 
rL-nuircs too much prep.i ra 1 1 oi^ / sco r i 

•-VUrii.ils -- need enrlrhmiMit activities 

need materials tl»at fit ].]:\ currleulun 

^^rudont-, helds back talrnteH 

-- remedial o(t task 

weak S;^ depend on strong; Ss 
~- absentees bard to hand ] c 

group 1 r.g Is d i f f Lcul t 

'■'isf-lpl ine le-;s tf-icher rontrol, morr uoise 



Turrit u 1 v;rr. 



does n(-»t fir al* !^uh j e c t s / p r a do s 
cnverage Ls reduced 

s crcarr.'lrv 1 s Inhibited 

observation creates fear, pressure 
nodel more u.sefu^ for new i^.iehrrs 

^^'it ac)iieVfi:pnt Is difficult to measure 

point svstcm rbunpinp,> is not popular 
chpLn:in« sbruld not he done hv Ss 

lark of researcli base 
-- conplex, difficult to Implement 
coding categories are judgmental 

I r. i im ('once rns 



Insulficienr central of f i,c* support 

Voor cer : d;n.tt icn (model, tr.a t e r 1 a 1 s , m. er.onrJ 

iV-'ople and lesourccs not used to meet :ect needs 

Inflexible budget prorr^ss 

I'nclcar evaluation guidelines 

No monitoring of observers 

heaving class to teacher subst : 

?nnr ror— i , inn teachers :on't know why node! 
1 s u s e d 

attiiMiU :.-'achcr apathy 
■"■^ * 'Viing students in learning 



L"Tr,er;!:lng a given mode! . 

.=Mast-rv learning; STI.-s.udont Tean '.earning; TV 



= To.irhinc 



36 



^0 




Many concerns related to consequences — the impact on particular kinds of 
students, on cur/iculum, and on discipline and the assessment of that impact. 
Teacher concerns are also consequential, with some personal overtones. 
Concerns about the design and some of the assessment concerns were related to 
refocusing a dissatisfaction with the model as implemented and a desire to 
do something different. General implementation concerns were reported for 
three models (there were none for STL), ^11 of them related to management^ 
with some personal or consequential overtones. These results are what might 
be expected given the age(s) of the projects. 

Recommendations were made by participants of all projects, and were 
categorized into six general areas: learning, teachers » classroom use, imple- 
mentation process, interactive support, and expansion/revision. (See Table 
11.) Learning recommendations related to the SoC "information'* stage, and 
reflected a cycling of sophistication and appreciation for on-going training 
and assistance: participants have learned and want to co. *:lnue learning — 
sometimes in a particular way or in a particular area of expertise. Recommen- 
dations for teachers related to the "personal" SoC stage and indicate that in 
some cases there is fear, resentment, or confusion that needs to be overcome 
(MI., STL, TV). Classroom use and implementation process recommendations 
related to two levels of management, and indicate that local implementers have 
become sufficiently familiar with the models to identify (and want to over- 
come) barriers to successful use. The AT recommendation for situational 
adaptation suggests a need to clarify understanding of the model (how it is 
explained, and how it is implemented). There were fewer management lecommen- 
dations for STL than for other models, which is somewhat surprising given the 
number of concerns about time and students. Recommendations classified as 
"management" were influenced by interest in consequences. The "collaboration" 
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Table 11 

•■.irt ic i p.iiu Ko.rornnciulr) t ion s : All "ndt.']s, ^- 



■'■"■'■■'H' IM•.^^;■U• Lr.iliuiM'. .)!wt rt)llnv-up a s s 1 s i .i n r 
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-- provide IT SCI re h results hcfdi i i r.;|; -;icnt a r i on 
r'^rnuragc tuachers lo ir:(i-unKo knowUdRtj i ski'il 
provislL- r.rre spfrlfic. i n s t rue r i on.a 1 i np n > v enen t 

-- ^'^u■aCc r'jsourr*'c for o 1 a s ; i .mm:^ oh sl- r v.i r i c>n 

' '"'^ ro'^u f l>ur<ien t.'n 1 

liavr .vnlv vrluprarv pa r l i i pa r i on Mr'.-. noL i^r 

I'VtTV Tl 

'v.'lp is see Value r" rKV.ld 

^--^n-p en-- ale Ts for al'rer school ac !: iv i r i s 

a 1 1 ov situational adaption 
' ^'^* naiiuain fidelity (and monitor) 

.1 1 Ku'a t n / a J i UK t use n f t i nc 
provide m.iterials 
-• sequence units more carefully 

have ability R roup i ng/ sma M e r classes 
-- develop record-keeping system <' compu t e r i ?: ed ) 
ievu'np strateKles to deal with absentees 

nplenentat ion allocate tine ^ deve 1 opment , paperwork. 
' ' prepa rat ion 

-- assign new leadership 

-- (io nnt add model on top of LF.A priority 
-- do not begin In first few days of semesfnr 

u'^e earlier in tlie year 

evaluate effectiveness 

rntLTarttve -~ iiir rease funding 

"^^'^'l''"'^ "■ increase central o/fice support 

'. norease MSnr/cent ra 1 office cooperation to 

help Ts solve problems 
i'lcre.ise MS HE assistance 

vr, courage no re networking among and within hPAs 

provide or develop materials 

inviMv'L' nore Ts in curriculum development 

I' 'Ml ,irMp i!io pr(V^^a^!l 

" ^ii^^rease Involvement schoo 1 s/grade s / sub j ec t s 
t rv .mother model 
u^e everv day 
U'.c for the full vear 
U-.C annther pai't 'luchiuquc of rn(^.del 



V-numher o^ I.PA- implen,cn t ing a given model. 

AT = .Vtive Teaching; Mh = M,,,terv Learning: STh^Student Toan hearning; T^ 
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stage related to what others are doing — interactive support — and most 
recommendations in this group indicate that school-based staff are not ready 
to take full responsibility for implementation (and perhaps should not be 
expected to do so). Recommendations about expansion or revision related to 
the "ref ocusing** stage, and mostly indicate that local educators value the 
models enough to want expansion (although opinions are divided for TV between 
expansion and termination and reflect concerns about the design and the way 
some teachers in some LEAs react to it) . 

If a project is to succeed, concerns and recommendations should be 
addressed by MSDE TAs and LEA teams. For AT, the most critical issue is local 
perceptions of the fit of the model to specific grades, subjects, or students 
(as grouped). For ML, the most critical issue is cost-effectiveness in terms 
of time allocated for unit and test development, and the subsequent record- 
keeping, in relation to the perceived value of the model. For STL, the most 
critical issue is cost-effectiveness in terms of teachers' investment in 
relation to impact (including discipline) on various kinds of students. For 
TV, the most critical issue is the perceptions — fear, apathy, resentment 
(primarily of teachers) — about local implementation decisions and about the 
model design. While those issues suggest negative impact in some sites, it 
should be noted that they are not pervasive and do not out-weigh the positive 
impacts reported earlier. 
Conclusions . 

While processes of implementation based on the research on planned change 
were recommended for all models in all LEAs, and TAs encouraged locdl educa- 
tors to attend to such principles as participatory decision-making, two-way 
communication, tra- :ing and support, and appropriate investment of time and 
energy, those prs^csses of implementation and principles were not always 
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applied.* When they were applied, Implementation went sufficiently pmoothlv 
for energy to move gradually from establishing structures, relation- ships, 
and expectations toward actual classroom use. When there were arbitrary 
administrative decisions, top-down or Incomplete communication, low support by 
central office staff, and Insufficient time allocated for materials 
development or group planning by teachers. Implementation problems occurred. 

At the local level, these principles or practices were generally referred 
to as Interactive support, and, depending on the nature and extent to which 
they were applied, had positive Impact or created barriers to success. (See 
Table 12.) 

Impact was made on student achievement by three models (AT, ML, STL), 
with the strongest evidence of success In mathematics and reading/ language 
arts for AT and ML. Positive results were most apparent when either of those 
models was used consistently over a period of time for a given subject and 
grade . 

Impact was made on student attitudes to some extent for all models. Data 
summarized by 12 projects (AT, ML, STL) Indicated that SITIP students enjoyed 
the lessons, did not find them difficult, and wanted to succeed. Friction 
among students, and their perception of favoritism and disorganization needed 
to be addressed at some sites. While teachers believed that for STL students 
self-esteem and willingness to work with others Increased, student data for 
STL Indicated no differences for that model in comparison to AT or ML. 



* In some cases » the responsibility for the low level of application was 
shared with the assigned TA. In other cases » the TA*s efforts were 
disregarded by local staff. 
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Table 1? 



Barriers and Facilitators to Successful Implcmentauon 



Barriers 


Faciljratorn 


Heavy reliance on training (ML, STL) 
Insufficient resources for training (STL) 
No foUow-up assistance (STL) 


Training and assistance responsive to Is' 
expressed needs (AT, ML, STL, TV) 


Rationed resources, broad development (ML) 


T time & skill to develop materials (AT, ML, 
STL) 

Resources allocated for development 


T adapt model (STL) 

T perceive no credibility of model (TV) 


Fidelity understood, advocated, i acknowledged 
by SA & CO (AT, ML, STL) 


CO maintain administrative control, but expect 
Work to be done by school staff without building 
ownership (AT, ML) 


CO demonstrate interest in project success (AT, 
ML, STL, TV) and acknowledge T efforts (AT, 
STL) CO act to overcome problems (AT) 


Plans overly ambitious (STL) 

Plans not followed by project leaders (STL) 

Purpose not clarified, mutually understood (TV) 


Shared planning, purpose setting, decision- 
making (ML, TV) 
Networking encouraged (ML, TV) 
SA fit model to school priority (TV) 


i 

K 

Ts perceive their efforts are devalued (ML) 


Ts believe their opinions and efforts count 
(ML, TV) 

Ts believe project is designed for improvement 

(TV) 

Ts value recommendations of observers (TV) 
SA emphasizes professional development (TV) 


Single energizer with low influence (AT) 
Conflicting messages (CO, SA, some MSDE) (ML, 
STL) 





AT-Active Teaching; ML*Mastery Learning; STL=Student Team Learning; TV=Teaching Variabl 
CO«central office staff; SA=school administrators; T«teachers. 
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Impact was made on teachers* knowledge for all models through training. 
Skills in a new teaching/ observat ion technique increased through classroom 
practice and coaching. Positive attitudes about teaching were strengthened as 
teachers experienced success. 

Impact was made on a scnool (the faculty and how instructional matters 
were dealt with) through commitment and sharing among teachers (ML, STL, TV), 
and provision of support (ML) and recognition of success (STL) by school 
administrators (usually the principal). Staff interest in teaching/ learning 
increased (AT, STL); there was more continuity across classes (AT); better 
management of instruction (TV); and closer monitm .ig of teaching (AT). 

Impact was made on school administrators* knowledge for all models 
through training, and they improved instructional management (AT), 
strengthened their belief in traditional teaching (AT), and were more appre- 
ciative of teachers* capability (AT, ML) as implementation occurred in their 
schools. 

Impact was made on central office staff's knowledge for all models 
through training, and, for AT, they improved instructional management as they 
became involved in implementation. 

At the system level, there was knowledge gain (STL), cross-hierarchical 
sharing and commitment (AT, ML), and policies enacted to release teachers to 
train others or coordinate activities (ML), and to implement the model 
district-wide for a given subject or grade level (AT). 

As stated earlier, the implementation strategy used influenced impact 
(with capacity-building being the least effective). Another strong influence 
was the relationship between a model and local priorities (as perceived by 
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local educators). Probably the strongest Influence on successful Impiementa- 
tlon was interactive support: while teachers can and do teach alone in their 
own classrooms, they do much better when their efforts and successes are 
acknowledged and they are part of a cross-hierarchica!". team working toward 
instructional improvement which benefits students. 

Summary and Conclusions 

Application of the research on planned change facilitated implementation 
of models of instructional improvement. The SITIP design encouraged collabo- 
ration, increased communication using a common knowledge base about school and 
classroom effectiveness, and helped LEAs establish cross-hierarchical teams 
with the purpose of improving instruction. Unless the principles of planned 
change were applied, the model adopted had little chance of success. 

The models themselves were perceived by local educators as having both 
subjective and objective value. Teachers' positive opinions had just as much 
influence as standardized test data in determining program maintenance or 
expansion. Teachers' negative opinions or concerns had a little influence in 
determining maintenance or expansion and did influence the relative impact of 
the project. 

Active Teaching and Mastery Learning, when implemented with fidelity for 
a complete course, had a positive impact on student achievement, and helped 
teachers to organize instruction effectively. The models were valued more by 
teachers when used for structured academic curricula than for more open-ended 
subject areas. Mastery Learning required considerable administrative support. 
Both models were more successful when administrators acknowledge t^^achers' 
efforts. 
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student Team Learning was popular with students and teachers and had a 
positive impact on achievement some cases. However, it was not used 
consistently, and so cause-and-ef f ect claims cannot be verified. Maintenance 
and expansion usually occured when teachers saw the value of the model, anil 
appropriate materials were available. 

Teaching Variables was used as a professional development process (and 
was then more likely to be valued by participants), or as part of a supervi- 
sion process (and was then more likely to be viewed with suspicion by 
teachers). Little evidence was provided to indicate impact on student 
achievement, but there were some reports of teachers improving their uanage- 
ment of instruction. 

Key staff in all LEAs, in 11% of Maryland's schools, in colleges of 
education, and at MSDE increased their understanding of recent research on 
planned change and school and classroom effectiveness. Nearly 1000 teachers 
modified their instructional techniques, and most of them believed that the 
results are worthwhile. The general attitude of all role groups involved in 
SITIP was positive, with appreciation for the opportunities for professional 
growth, and for the benefits to students receiving improved instruction. 

During the 1983-8'4 school year, local implementation will continue to be 
supported by MSDE, with attention to participant concerns and recommendations 
and to the results reported here. SITIP advocates hope that LEAs will make 
purposeful data-based decisions — either to terminate or to institutionalize, 
preferably the latter with local commitment to build on the state initiative. 
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